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PREFACE 

This report presents the results of a study entitled "The Application 
of Biocybernetic Techniques to Enhance Pilot Performance During Tactical 
Missions." The research was conducted by the McDonnell Douglas Astronautics 
Company-St. Louis Division for tiie Defense Advanced Research Projects Agency 
(DARPA) under contract MDA-903-78-C-0181. The preparation of a second 
document - "Proceedings of the DARPA Conference on Biocybernetic Applications 
for Military Systems," Chicago, April 1978 - also was supported by this 
contract. 

We acknowledge the assistance of Dr. Craig I. Fields, Senior Program 
Manager, Cybernetics Technology Office of the Defense Advanced Research 
Projects Agency. 
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1.0 ABSTRACT 


This report describes a rather novel means of enhancing man's performance 
in highly complex, crew station environments. Specifically, we have related 
the benefits of on-line evaluation of physiological data to projected mission 
requirements for a 1990 tactical aircraft. 


The salient role that tactical air power must continue to play in the 
structure of U.S. defense forces has engendered a sophisticated technological 
approach to weapon system development. Therefore, we begin with an overview 
of the components of a "high technology" weapon system - real-time command 
and control, advanced crew station and avionics design, effective defense 
suppression, sensor aided target acquisition, and precision-yuided ordnance. 
Although a reliance upon advanced technology and a trend toward greater 
automation of aircraft functions are clearly evident, the importance of the 
human element should not be underestimated. This is especially true if the 
system is to retain the capacity to anticipate and respond to unpredictable 
threats. Herein lies the present dilemma. Man-in-the-1oop assures that 
tactical aircraft will have an inherent flexibility. However, if man is 
unable to perform increasingly complex tasks both rapidly ana accurately 
under all combat situations, he may severely limit, and perhaps even under¬ 
mine, the inventive technology of the system he controls. 


It may be possible to solve this problem by taking advantage of the same 
improvements in digital computation and signal processing that currently 
influence hardware development. .That is, we may enhance the pilot's effec¬ 


tiveness if we monitor momentary fluctuations in attentiveness and in his 
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ability to process information and make appropriate decisions. The report 

summarizes research which has demonstrated that these mental activities are 
manifest in distinct electrophysiological signals, and that such signals, 
recorded noninvasively and unobtrusively, can be analyzed and interpreted in 
real-time. On this basis, we suggest that the central computer onboard the 
aircraft may be able to determine: 

o when the pilot is inattentive, 

o when visual or auditory information has not been processed, 
o when the pilot is task-loaded to the extent that he is unable to 
accept additional duties, 

o when the pilot lacks confidence in a decision he has made. 

For a variety of mission segments we then outline the courses of action which 
can be taken to unburden or assist the pilot if biological signal processing 
has forewarned an imminent deterioration in his capacity to perform. The 
actions include, among others: 

o redistributing task responsibilities, 

o reducing the complexity of or "decl uttering" information displays, 
especially the HUD, 

o cueing the pilot to attend to critical flight, weapons, and target 
data, 

o displaying adaptive decision aids which present weighted recommen¬ 
dations for mission-related strategies, particularly with respect to 
fire control functions, 
o furnishing remedial "checklists," 

o optimizing the physical characteristics (e.g., contrast, focus, etc.) 
of imagery and symbolic presentations. 
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The recording and analysis of electrophysiological data also may permit 

a direct coupling of the pilot with aircraft subsystems from a control 
standpoint. At issue is whether it will be possible to interpret bioelectric 
patterns related to different thought commands, whereby the pilot can "think" 
to activate control surfaces. 

We are aware that a great deal more must be accomplished (in computer 
technology, software development, and the design of physiological monitoring 
equipment) before it is both feasible and practical to apply biocybernetic 
techniques in dynamic, operational environments. Nonethel ess, we have 
attempted to clarify important basic research issues and to recommend reason¬ 
able priorities for future investigations. 
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2.0 INTRODUCTION 


Generally stated, our purpose has been to assess the impact of applying 
biocybernetic^ techniques to improve human performance and thus enhance 
system effectiveness. We have made several assumptions in undertaking this 
assessement. 

o The human operator is and will remain an integral component of 
evolving computer-based systems. 

o These advanced systems will be adaptive, that is, the distribution of 
responsibilities between the operator and the system will be modified 
as circumstances change. 

The computer-based system with which we are concerned is a generic 
tactical aircraft, and the human operator in this instance is more commonly 
referred to as a pilot. With respect to the data requirements for imple¬ 
menting adaptive procedures, we find that digital avionics programs within 
the Air Force and Navy are providing the means for a reliable and efficient 
flow of information about the current status of aircraft subsystems. Via 
external sensing, the pilot also will be apprised of the changing posture of 
the mission. 


^ The term denotes a real-time communication link between a human operator 
and the system he controls, that is based upon the physiological activity 
which is recorded as the operator performs assigned tasks. 
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Rapidly occurring developments in digital computation, data-busing, 

electronic circuitry, display generation, and input/output technology have 
created a trend toward greater automation. This will reduce the extent to 
which the pilot participates in housekeeping functions (i.e., navigation, 
subsystems monitoring, communications, and aircraft control), thereby allow¬ 
ing him to attend more closely to mission-related activities (i.e., detec¬ 
tion, location, identification, decision, execution, and assessment). The 
pilot will, of course, play a direct role in any housekeeping function if 
alerted of a subsystem failure. 

While the communication link from subsystem to computer is impressive 
indeed, we may ask whether comparable means are available for the pilot to 
convey status information to the computer. Status in this context refers to 
momentary fluctuations in attentiveness or in the ability to process infor¬ 
mation and make appropriate decisions. An operator usually communicates with 
a computer via manual responses or perhaps a small vocabulary of verbal 
responses. It is unlikely that these inputs are sufficiently sensitive to 
the types of momentary fluctuations mentioned above. And even if overt 
behavioral measures could provide such information, the process of supplying 
it on demand might prove extremely disruptive to critical mission-related 
tasks. 

The program of biocybernetics research sponsored by DARPA since 1974 
has attempted to alleviate the imbalance in the flow of status information 
by adding a communication channel from the operator to the computer. In 
describing the program, Donchin (1979) states: 
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"A channel carrying psychophysiological data (unobtrusively) acquired 
from the operator can supply the adaptive controller with at least part 
of the necessary information. The program thus assumes that mental 
activities manifest themselves in a variety of physiological signals. 

It further assumes that it is possible to make strong inferences about 
mental activity from such signals." (p. 3) 

We believe that the virtue of this communication channel is not limited 
to the conveyance of status information for the purpose of effecting more or 
less automation. Rather, we also envisage, among other applications, a 
direct coupling of the pilot to aircraft subsystems from a control stand¬ 
point, such as through "thought" commands. 

In this report, we examine whether the pilot's ability to satisfy tac¬ 
tical mission requirements can be enhanced if electrophysiological manifes¬ 
tations of brain function are processed by the central computer. We discuss 
quick-reaction situations, where the crew member is vulnerable and where 
performance accuracy or the speed of response may be improved. While brain 
electrical activity is emphasized, we consider other biological signals as 
well. These include peripheral psychophysiological responses and aspects 
of ocular behavior. 

We have concentrated on pilot tasks associated with (a) the extraction 
of displayed information and auditory messages, (b) decision-making based 
upon subsequent processing of these inputs, and (c) control activation. 
Moreover, the pilot tasks we describe in detail were chosen because they are 
very difficult and/or are critical to the success of the mission, or because 
they occur during periods of high workload. 
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The next section of the report summarizes relevant "ground rules" for 

biocybernetic applications in a 1990 time period. As describea previously 
(Gomer and Youngling, 1978), there are significant technical difficulties to 
be overcome before closed-loop concepts can be incorporated in operational 
settings. We feel that the time frame which has been adopted is reasonable, 
in view of the necessity for long-term planning. Sections 4 and 5 compare 
general mission requirements for the principal mission types and outline the 
information needs of the pilot, respectively. Three major subsections 
comprise Section 6. The first presents time line analyses of pilot tasks 
for a postulated escort mission. This is followed by a discussion of the 
particular categories of biological signals which, when interpreted by the 
computer, offer the most promise for improving task performance. Finally, 
biocybernetic applications are presented in a matrix format for each of 
thirteen integrated mission segments. Section 7 then offers conclusions and 
recommendations. 
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3.0 AN OVERVIEW OF MISSION TYPES AND PROJECTED 
TECHNOLOGY ADVANCES FOR TACTICAL AIRCRAFT 


This summary information is intended to provide a framework for later 
discussions of pilot tasks and potential biocybernetic applications. 

In general, we have assumed a Central European Theatre (CET), and this 
has influenced mission requirements, projected weapons, and aircrew func¬ 
tions. We also have recognized the trend toward one-man aircraft, due to 
reduced procurement, operating, and training costs, and the fact that fewer 
personnel are exposed to combat. We assume that vehicle characteristics will 
be typical of a two engine high performance aircraft (perhaps with direct 
force flight control). Ordnance should consist principally of stand-off type 

3 

weapons, and command, control, and communication (C ) should encompass: 
Airborne Warning and Control Systems (AWACS), Global Positioning Satellite 
(GPS), and Joint Tactical Information Distribution System (JTIDS). 

We believe that advanced crew stations will be developed with a concern 
for efficient information flow between the pilot and the various aircraft 
subsystems (cf. Mills et al., 1978 ). Figures 3.1 and 3.2 i 1 lustrate the 
essential elements of such a crew station. Included will be: 

(1) Vertical Situation Display (VSD) - presents attitude and position 
information in the vertical plane, also predictive or command 
symbology for all flight phases, 

(2) Horizontal Situation Display (HSD) - provides geographic information 
in the form of terrain images, computer generated navigational 
maps and supporting symbology, and tactics, 
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FIGURE 3.1 INTEGRATED CREW STATION CONCEPT FOR A 
1990 TACTICAL AIRCRAFT. 
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1. Head Up Display 

2. Head Up Display Camera 

3. Threat Alert 

4. Canopy Alert 

5. CNI/ECM/HUO Control 

6. Digital Clock 

7. R/H Engine Fire Alert and Extinguisher Button 

8. Radio Call Number 

9. Back Up Display Select Panel 

10. Multimode Display No. 2 

11. Takeoff Check List and Spare 

12. Spare Panel 

11 Caution and Advisory Panel 

14. Hydraulic Pressure 

15. Vertical Situation Oisplay/Tactical Display 
(Multimode) 

16. Armament Station Salect/Selective Jettison Panel 

17. Horizontal Situation Display and Moving Map 
(Multimode) 

FIGURE 3.2 DESCRIPTIONS OF THE INSTRUMENTS DEPICTED 
IN FIGURE 3.1. 
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18. Jet Fuel Starter 

19. Rudder Pedal Adjustment 

20. Emergency Brake 

21. Multimode Display No. 1 

22. Surface Position Indicators (Ref) 

23. Fuel Quantity Panel (Ref) 

24. Critical Engine Status (Ref) 

25. Oil and Pneumatic Pressure 

26. Landing Gear Position Indicator 

27. Gear All Stores Emergency Jettison 

28. Landing Check List and Spare 

29. Mode Advisory Panel 

30. L/H Engine Fire Alert and Extinguisher Button 

31. Armament Master Arm Switch 

32. Landing Gear Alert 

33. Fire Extinguisher Arm Switch 

34. Master Caution 
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(3) Multipurpose Displays (MPDs) - present system malfunctions auto¬ 
matically; operator selects via keyboard the information he desires 
(e.g., engine parameters, flight checklists, target designations, 
weapons status, sensor FOV, etc.), 

(4) Head-Up Display (HUD) - presents weapons delivery and flight 
information, also limited video, 

(5) Helmet-Mounted Display (HMD) - a virtual image display (as is the 
HUD) which also presents weapons delivery and flight information; 
however, it obviates the usual requirement of a fixed display 
location, 

(6) Multifunction Control Unit (MFCU) - allows the pilot to sequence 
display presentations via keyboard inputs, 

(7) Hands-On-Throttl e-And-Stick (HOTAS) Controls - fly-by-wire, with 
critical subsystem (particularly weapons) controls integrated 
directly into the stick and throttle. 

Growing alarm over the task demands imposed on the pilot and severe 
space limitations within the crew stations of existing tactical aircraft have 
forced engineers to discard a design philosophy which prescribes the use of 
dedicated, single-purpose instruments. An accelerated obsolescence of this 
conventional approach to crew station design and a new emphasis on multi¬ 
purpose displays and keyboards have been brought about by remarkable develop¬ 
ments in two areas: digital avionics and programmable electronic display 
devices. Large scale integration (LSI) technology has produced the necessary 
microcircuit/ microprocessor electronics to create an extremely flexible 
display generation capability. Raster-scan graphics can be used to generate 
realistic and varied synthetic visual scenes, and they afford an ease of 
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mixing display symbology with the outputs of imaging sensors such as radar, 

low-light-level TV, and forward looking infrared. Display presentations can 
be limited (in theory) to those sources of information which are most relevant 
at a specific time period in the mission. Moreover, the sequencing of 
presentations can be controlled by the particular computer program(s) in 
operation and by the crew member's keyboard inputs. 

While numerous display developments are in progress that offer great 
promise for the 1990 time frame we have adopted, the cathode ray tube (CRT) 
in all likelihood will remain preeminent. It has a superb capability for 
presenting almost unlimited formats (including video). 

3.1 MISSION TYPES 

Tactical Air Power (TACAIR) recognizes three primary missions to accom¬ 
plish the objective of successfully waging war. The missions are Close Air 
Support (CAS), Air Interdiction (AI), and Counter Air (CA). Although there 
are other TACAIR missions, such as Reconnaissance and Electronic Warfare, 
they generally are conceived to be supportive of offensive air-to-air and 
air-to-ground missions. Mission definitions are as follows: 

Close Air Support - Air action against hostile ground targets that are 
in close proximity to friendly ground forces. This requires detailed 
integration of each air mission with the battle activities and movements 
of those forces. 
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Air Interdiction - Air operations conducted to destroy, neutralize or 

delay the enemy's military potential before it can be brought to bear 
against friendly forces. These operations are conducted at such dis¬ 
tances from friendly forces that detailed integration of air and ground 
activities is not required. 

Counter Ai r - Air operations conducted to attain or maintain a desired 
degree of air superiority by the destruction or neutralization of enemy 
air forces. Both offensive and defensive air actions are involved. 
Offensive actions range throughout enemy territory and generally are 
conducted at the initiative of the friendly forces. Defensive operations 
are conducted near to or over friendly territory and usually are reactive 
to the initiative of the enemy air forces. 

Figure 3.3 summarizes the scope of TACAIR’s three primary missions. 
Obviously, a large number of mission profiles will emerge for each mission 
type, given the unpredictable nature of enemy operations and the broad range 

3 

of weapons, sensors, and C systems employed by friendly air forces. Conse¬ 
quently, comprehensive yet representative profiles were developed for the 
three inissions. 

We have chosen to concentrate on the basic elements of each mission and 
to avoid excessive concern for mission details that infrequently impact 
aircrew tasks. For example, a pilot does not particularly care whether he 
penetrates at 0.85 or 0.92 Mach, at 25,000 or 29,000 ft, or whether he pulls 
6.2 or 7.1 g's. These are operational techniques that take advantage of 
particular design features and overall aircraft performance. Once a pilot is 
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FIGURE 3.3 PICTORIAL REPRESENTATION OF THE THREE 
TACAIR MISSIONS. 
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thoroughly familiar with an aircraft he usually develops "rules of thumb" to 

cover the situations most commonly encountered. A pilot frequently will fly 
mission segments, such as low level routes, at airspeeds which are even 
tenths of a Mach (0.7, 0.8, or 0.9) or multiples of 60 knots (420, 480, 540). 

This is done in lieu of best cruise or other optimum speeds because it 
facilitates solving in-flight timing problems, an important parameter in all 
offensive air missions. 

The previous example illustrated that mission timing can be more impor¬ 
tant than optimum penetration speed. Many other examples are possible that 
would further contrast pilot and aircraft design priorities. The mission 
profiles that follow emphasize the pilot priorities, especially in terms of 
decision-making functions and information needs. 

General mission requirements are identified in Figure 3.4 for pre-flight, 
in-flight, and post-flight phases. Representative mission profiles were 
constructed from these requirements and are illustrated in Figures 3.5 
through 3.7 for Close Air Support, Air Interdiction, and Counter Air missions, 
respectively. A detailed comparison of mission requirements for the three 
mission types is presented in Section 4.0. 

Although we have considered the mission requirements individually, they 
overlap significantly in operational situations. 
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1. Pre-Flight - All aircrew functions leading up to and Including takeoff. 

1.1 Mission Planning 

1.2 Preflight 

1.3 Start and System Checks 

1.4 Taxi 

1.5 Arming 

1.6 Takeoff 


2. In-Flight - All flight activities beginning with climb and concluding at 
the termination of the landing roll. 

2.1 Climb to Level-Off 

2.2 Cruise 

2.3 Loiter 

2.4 Rendezvous and Air-to-Air Refueling (AAR) 

2.5 Coordination 

2.6 Mission Rendezvous 

2.7 Penetration 

2.8 Threat Warning 

2.9 Detection 

2.10 Location 

2.11 Identification 

2.12 Decision 

2.13 Execution 

2.14 Assessment 

2.15 Termination 

2.16 Egress 

2.17 Cruise 

2.18 Rendezvous and Air-to-Air Refueling (AAR) 

2.19 Reengage 

2.20 Return to Base 

2.21 Descent 

2.22 Approach 

2.23 Landing 

3. Post-Flight - All mission-related activities beginning after the completion 
of the landing roll and ending when the aircrew is free to perform other 
duties or pursue personal Interests. 

3.1 De-arm 

3.2 Taxi 

3.3 System Checks 

3.4 Shutdown 

3.5 Post-Flight 

3.6 Debrief 


FIGURE 3.4 GENERAL MISSION REQUIREMENTS FOR PRE-FLIGHT, 
IN-FLIGHT, AND POST-FLIGHT PHASES. 
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Debriefing 1. Parentheses indicate optional phases. 

2 . Numbers refer to phase of flight and mission requirement. 


FIGURE 3.5 MISSION PROFILE FOR CLOSE AIR SUPPORT. 
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Debriefing 


2. Numbers refer to phase of flight and mission requirement. 


FIGURE 3.6 MISSION PROFILE FOR AIR INTERDICTION. 
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Debriefing 1. Parentheses indicate optional phases. 

2. Numbers refer to phase of flight and mission requirement. 


FIGURE 3.7 MISSION PROFILE FOR COUNTER AIR. 
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3.2 TECHNOLOGY ADVANCES 

3.2.1 Weapons - The CET's defenses, weather, terrain, and target 
characteristics (size, mobility, signature) compromise the effectiveness of 
many weapons which currently are operational (cf. Levine, Beideman, and 
Youngling, 1978). Therefore, new concepts are needed. Stand-off weapons, 
both unitary and dispenser types, with midcourse and terminal guidance offer 
one of the most feasible solutions. Figure 3.8 summarizes the characteristics 
of various guidance options. These guidance systems also can be used in 
combination. For example, midcourse guidance can be inertial while terminal 
guidance can be imaging infrared (IIR) with data link lock-on. 

It is important to emphasize that the key features of future weapons 
are that they be stand-off and that they possess accurate guidance and 
control. The net results are to increase survivability and effectiveness and 
to reduce losses and the resources required to destroy a target. 

Figure 3.9 defines the various air-to-air missiles that influence pilot 
tasks. The physical characteristics are listed, as are the system components 
associated with a successful missile deployment. Important to the crew 
station designer are the cockpit components that are required to launch each 
missile. The basic purpose of each missile has been provided in the "Remarks" 
column. 

Figures 3.10 and 3.11 present similar information for air-to-surface 
ballistic weapons and air-to-surface missiles, respectively. 
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FIGURE 3.10 TYPES OF AIR-TO-SURFACE BALLISTIC WEAPONS. 
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FIGURE 3. 1 1 TYPES OF AIR-TO-SURFACE MISSILES. 
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3.2.2 Avionics - The reduction in the cost of digital circuitry and the 

advantages of expandable memory are responsible for an increase in the use of 
digital computers onboard military aircraft. Most importantly, the avionics 
are more integrated, with the various subsystems under the control of higher 
level systems which, in turn, are under the control of the pilot. By effec¬ 
tive interconnection of subsystems workload can be reduced, permitting the 
pilot to concentrate on those tasks which the central computer cannot handle 
effectively. 

The advances in electronics will result in more accurate navigation, 
improved night and adverse weather target detection, jam resistant communica¬ 
tions, and more effective countermeasures. The largest payoff may be in 
terms of better command, control and communication (C ) systems. The pro¬ 
grams most likely to affect aircraft systems and crew information require¬ 
ments are the Joint Tactical Information Distribution System (JT IDS) and the 

3 

Airborne Warning and Control System (AWACS). Although not directly a C 
program, the Global Positioning System (GPS) may interface with JTIDS for 
navigation and blind navigation bombing purposes. 

A summary of anticipated avionics improvements is shown in Figure 3.12, 
with reference to the Air Force Digital Avionics Information System (DAIS). 

3.2.2.1 Sensors - The information which is displayed during various 
phases of the mission is derived from two sources: (a) real-time sensors and 
(b) the a priori data base stored in the aircraft computers before takeoff. 

In general, those data which are retrieved assist the pilot in performing 

monitoring, navigation, threat location, and target acquisition functions. 
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Function 

Equipment Type 

Anticipated Advances 

NAV 

Inertial 

Strapdown; improved gimballed systems 


ADC 

Computations performed in processor 


TACAN, ILS, ADF 

Weight, size, power consumption 


GPS. OMEGA 

Will become operational 


Hybrids 

GPS/inertial available 

COM 


MSI, LSI; Shared Antenna ; Modulation 
techniques 


JTIDS 

Will become operational 


IFF 

Improved performance, cost reductions 

ECM 


Power management 

Air/Ground Attack 

Lasers 

Laser target seekers will become 
operational 


FLIP 

Reduced costs, weight, size; improved 
display 


FLR 

Improved performance, reliability 

C/D 

Controls 4 Displays 

Current displays and controls will be 
replaced by compucer-driven MPD 
plus IMFK 

Processing 

Processors 

LSI technology and microprocessors 
with large central processing capa¬ 
bility 

BITE contained within microprocessors 

MOS (metal oxide semiconductors) 

Bipolar Schottky transistor-transistor 
logic 

Power Supply 


Central power supply core element 

Interface Equipment 

BCIU, RTO 

Integrated within sensor or processor 


FIGURE 3.12 ANTICIPATED AVIONICS ADVANCES (WITH REFERENCE 
TO DAIS). 
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The sensors, on the other hand, provide essential infonnation for all house¬ 
keeping and mission-related functions, particularly navigation, communication, 
threat detection/ location, and the execution of air-to-air or air-to-ground 
attack. 

Representative sensors onboard the aircraft include: 

o multimode radar and forward looking EO or IR sensors for target 
recognition; laser designator/ranger/tracker for attack, 
o imaging seekers for missile guidance (see Figure 3.8) (implied is the 
dedicated fire control computer for directing these seekers to the 
aimpoint coordinates available from the target acquisition sensors), 
o navigational sensors for INS, TACAN, and GPS, 

o radar and laser threat (ground and air) warning sensors, IFF threat 
identification receivers, and data-link receivers (e.g., JTIDS). 

We should mention that a more inclusive listing would encompass the feedback 
devices which are used to monitor the status of the various aircraft sub¬ 
systems. By restricting our focus to those baseline sensors listed above, 
however, we can describe their characteristies in greater detail (see Figure 
3.13). 

3.2.2.2 Electronic Displays - In the next two sections (4 and 5) of 
this report, the mission requirements and the associated infonnation needs of 
the pilot are described for the reader. These sections demonstrate that 
flexibility in display generation is essential to satisfy future mission 
objectives. The pilot must be able to select, or be provided automatically, 
integrated information which is updated or changed accordingly across specific 
time periods in the mission. 
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We stated earlier that flexibility is afforded, in part, by the incorpor¬ 
ation of multifunction display techniques. Our purpose in this subsection is 
to present a brief comparison of those electronic display media which will be 
competing for inclusion in tactical crew stations during the 1990s. Recall 
that Figures 3.1 and 3.2 illustrated the display units which will present 
visual information to the pilot. They consisted of: 
o Multipurpose Displays (MPDs), 
o Horizontal Situation Display (HSD), 
o Vertical Situation Display (VSD), 
o Head-Up Display (HUD), 
o Helmet-Mounted Display (HMD). 

Presentation media for alpha numerics, symbolic characters, graphics, and 
full video should include: 

o Cathode Ray Tubes (CRTs), 
o Liquid Crystals (LCs), 
o Plasma Devices (PLDs), 
o Light Emitting Diodes (LEDs), 
o Electroluminescence Devices (ELs), 
o Laser Displays (LDs), 
o Electromechanical Devices (EMDs). 

To allow a meaningful comparison of these display devices, consider the 
information formats and coding rchemes (Figure 3.14) with respect to which 
the competing technologies will be assessed (see Figure 3.15). Other factors 
certainly must be taken into account when establishing evaluation criteria, 
and these are illustrated selectively in Figure 3.16. 
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A - On-off: legend 

B - Alpha numerics: fixed alphabet 

Cl - Characters (symbols and alpha numerics), raster or matrix 
generated: variable alphabet 

C2 - Characters, stroke generated: variable alphabet 

D - Graphics and characters: fixed format and alphabet 

El - Graphics and characters, raster or matrix generated: 
variable format and alphabet 

E2 - Graphics and characters, stroke generated: variable format 
and alphabet 

F - Full video (or fixed image) 

G - Color coding 

H - Size coding 

I - Depth coding 

J - Time coding (typically a software problem) 


FIGURE 3.14 INFORMATION FORMATS AND DISPLAY CODING SCHEMES. 
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DISPLAY TECHNOLOGIES 


DISPLAY 

FORMAT 

TYPES 

(SEE FIGURE 
3.14) 



LD 

EMD 

EL 

LED 

PLD 

LC 

CRT 

A 

X 

X 


X 

X 

X 

X 

B 

X 

X 

X 

X 

X 

X 

X 

C 1 

X 



X 

X 

X 

X 

C 2 

X 







D 

X 

X 


X 

X 

X 

X 

E 1 • 



X 

X 

X 

X 

X 

E 2 

X 






X 

F 

X 



? 

? 

X 

X 

G 

X 

X 

X 

? 

? 


? 

H 

X 

? 

X 

X 

X 

X 

X 

I 








J 

X 

? 

X 

X 

X 

X 

X 


FIGURE 3.15 COMPARISON OF DISPLAY TECHNOLOGIES, WITH RESPECT 
TO INFORMATION FORMATS AND CODING SCHEMES. 
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PARAMETER 

PLASMA PANEL 

Mi 1 


LIQUID 

CRYSTAL 

CRT 

Resolution 

30-60 epi 

20-50 eoi. large panels 
500 epi, small panels 

30-50 epi 

100 epi, large panels 
588 epi, small panels 

120-1600 epi 

Brightness 

>30-50 ft L 

>30 ft L 

.100 ft L . 

Ambient OeDendent 

.30-1000 ft L 

Contrast 

2,20:1 Binary 

^10:1 Full Video 

100:1 

20:1 Full Video 

20:1 Full Viaeo 

Oisplay Size 

<1024 elements 

T7 inch sq 
(ac driven) 

240 elements. 6 inch 

500 elements, 1 inch 

250 elements, 

6 in. sg. 

350 elements, 3.5 in. 
600 elements, 1 in. 

480-830 elements 
1-25 inch sq. 

Color 

Primarily Neon 
Orange Full 

Color Possible 

Phosphor Dependent 

Full Color Possible 

Red; green and 
yellow also 
available 

Primary Black/White 
but Contrasting 

Colors are Available 

Phosphor 

Dependent, 
Oiscrete Colors 
Also 

Power 

Requirements 

200-300W 

low 

1,5-2.0W/cm 2 
01.5-2.0 volts 

5„w/cm2 to 1.0 mW/cm^ 
@3-15 volts 

100 watts 

Thickness 

<1 inch 

<1 inch 

<1 inch 

<1 inch 

=12-18 inch 

Height 

50 lbs 

- 

- 


Up to 50 Lbs. 

Environment 

Rugged 

Rugged 

Rugged 

Rugged but Tempera¬ 
ture Limits 

Rugged 1 zed 

Aspect 

Viewing 

Wide Aspect 

Uniform, Wide Aspect 

Slight Gain 8ut 
Basically Uniform 

Restricted 

Uniform Wide 

Time Constants 

Std. Video 
(dc driven) 

Compatible With Std. 
Video 

Compatible With 
Std. Video 

10-500 rns (with scan 
converter 1C can 
display std. video) 

3-lOMHz Std. 

Video 

Storage/ 

Refresh 

yes (ac driven) 
no (dc driven) 

Yes, but is config¬ 
uration dependent 

No 

Limited Storage 

None (storage 

CRTs are 
available) 

Rel iabi 1 i t>/ 
Malntainabii1ty 

100.000 hrs LRU 

1.000 to 10,000 hrs. 

LP.U 

10,000 to 100,000 
hrs, LRU 

20,000 hrs, LRU 

15 to 15,000 hrs. 
LRU 

Status 

Operational/ 
Coitwercial !y 
Available 

Laboratory Demonstra¬ 
tion Models 

Commercially 

Available/ 

Operational 

Operational/Labor¬ 
atory Demonstration 
Models 

Operational 


FIGURE 3.16 EVALUATION PARAMETERS AND CORRESPONDING 
PERFORMANCES OF SELECTED DISPLAY DEVICES. 
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The CRT will probably remain the fundamental display medium in the 

1990s, because of its versatility in generating data for all display units 
listed above (i.e., MPD, HSD, VSD, HUD, HMD). However, as new display media 
are developed (e.y., electrophoretic, magnetic particle, and electrochroinatic 
devices) the pilot's information needs, which translate to display formats 
and codes, must be considered as the most significant evaluation criterion. 

3.2.2.3 Multifunction Control Unit - Multifunction switches, a rela¬ 
tively new concept in control technology (see Figure 3.1), are a counter¬ 
part of computer generated multifunction displays. They may be thought 
of as versatile sets of switch contacts which perform different switching 
operations. 

Each switch within a iuu11ifunction control unit addresses computer 
logic, which determines the specific function of that switch and initiates 
the desired action when the control surface is activitated. Since the 
function of a particular switch changes, current status of the switch must be 
displayed. There are several ways in which this can be accomplished: 

o rear projecting legends onto pushbutton switches, 

o generating legends remotely and transmitting to switch face with 
fiber optics, 

o generating legends on an electronic display with switches located in 
the periphery, 

o generating legends on an electronic display and then activating the 
area which has been designated (touch, light pen, photo-sensitive 
detectors, etc.), 

o generating legends directly on the switch face. 
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3.2.2.4 Voice Actuated Controls - As modern aircraft become increasingly 
more sophisticated, additional responsibilities are created which add to an 
already burdensome pilot workload. The concept of voice actuated systems 
(VAS) is one potential solution to this problem. In fact, the applications 
can be extended in principle to incorporate “thought" commands, as discussed 
in Subsection 6.3. 

The purpose of VAS is to permit more direct communication with the 
computer, thereby alleviating conventional workload and providing additional 
time to perform higher level tasks. 

The particularly desirable features of VAS are: a reduction in manual 
control procedures (especially during critical fliyht phases), a reduction in 
eye-hand coordination problems, and a reduction in visual demands inside the 
cockpit. A representative application may be found in weapons delivery. 
During this mission phase, the pilot is concerned with the sequence of events 
necessary to properly arm and deliver weapons on a target, to maintain 
altitude and airspeed within acceptable limits, to perform required communica¬ 
tions, and to remain alert for enemy threats. With VAS, it may be possible 
for the pilot to change radio channels and to arm and deliver weapons by 
simple voice commands. Hence, more time and attention can be given to target 
acquisition, lock-on, flight control and threat avoidance. 

Voice data entry systems are already in use for a number of interactive 
command and control functions. However, these systems have a limited vocab¬ 
ulary and are speaker specific. Vocabularies typically consist of digits and 
a small set of control words and phrases. 
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3.2.2.5 Joint Tactical Information Distribution System (JTIDS) - JTIUS 

is a digital communication system for secure, real-time command and control 
of combat operations. JTIDS will interconnect the tactical defense elements 
of all services with survei 11 ance/intel legence centers and with command and 
control centers in the theatre of operations. Precise time-of-arrival 
measurements, coupled with the transmission of emitter location, are used to 
generate a common grid coordinate system containing the location of all 
active net participants. The system uses Time Division Multiple Access 
(TDMA) to interconnect all users via one common channel for the distribution 
of information. Each authorized element is allocated a number of trans¬ 
mission time slots. When not transmitting, each element monitors the trans¬ 
missions of all other elements and extracts the information as needed. 

Although the specific benefits of JTIDS have not been documented, 
several generic benefits affect tactical missions. These are: 
o jam resistant communications, 
o intercept enhancement, 

o "Beyond Visual Range" threat identification, 
o supplementary threat warning, 
o relative nagivation, 
o blind NAV bombing capability. 

JTIDS is a multiphased program which is scheduled to achieve full 
operational status by 1984. 
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3.2.2.6 Airborne Warning and Control System (AWACS) - AWACS will 

provide air surveillance for command, control and communication functions 
throughout the U.S. and overseas. Its radar will detect and track aircraft 
at any altitude over land and water. 

3.2.2.7 Global Positioning Satellite (GPS) - GPS will provide precise, 
three-dimensional position and velocity information to aircraft, ships, and 
ground forces. The GPS development is currently in the validation phase, 
with early results indicating that the system can meet anticipated accuracy 
requirements. Full scale development should begin in 1982. Eventually, 24 
satellites will be orbited for full global coverage by 1984. 


\ 
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General mission requirements were listed earlier (see Figure 3.4) for 
pre-flight, in-flight, and post-flight phases. From these requirements, 
representative mission profiles were illustrated for Close Air Support, Air 
Interdiction, and Counter Air missions (see Figures 3.5, 3.6, and 3.7, 
respectively). 


Our intent in this section of the report is to describe the mission 
requirements in more detail. This is followed (in Section 5) by an examina¬ 
tion of pilot information needs. After establishing tactical objectives and 
defining the corresponding information requirements, we present (in Section 
6) time line analyses of the specific tasks which must be performed. 

We have chosen a presentation format (adapted from Mills et al., 1978) 
which will facilitate comparison of the requirements for the principal TACAIR 
missions. The numbering scheme used to identify individual mission require¬ 
ments is the same as that used in Figure 3.4. Notes are included when 
further clarification or differentiation is necessary. We should emphasize, 
again, that the mission requirements overlap in combat situations. 
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FIGURE 4.1 


PRE-FLIGHT MISSION REQUIREMENTS FOR CLOSE AIR 
SUPPORT, AIR INTERDICTION, AND COUNTER AIR. 
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(4) Most pre-flight tasks are performed In advance of an alert. Otherwise, these tasks are performed just prior 
to the mission. Alert status requires specified aircraft and aircrews and, therefore, reduces the resources 
available for other missions or duties. 
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FIGURE 4.6 IN-FLIGHT MISSION REQUIREMENTS (CONTINUED). 
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(18) The decision-making process Is not easy to explain. Training, ROEs, previous experience, and many other 
factors affect split-second decisions to release weapons. 
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. 5.0 INFORMATION NEEDS 
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It should be obvious, frori! even a cursory reading of the mission require¬ 
ments, that a combat pilot must spend considerable time processing displayed 
information. In Section 3, we reviewed the various display units which will 
present visual information during the 1990s (see Figures 3.1 and 3.2). In 
this section, we are concerned with the specific types of information which 
must be displayed at different stages of each TACAIR mission. Therefore, we 
have provided comprehensive listings of information requirements. We believe 
that the mission and information requirements, coupled with the aircraft 
characteristics, determine the assignment and sequencing of pilot tasks. 

The tabulations which appear in Figures 5.1 through 5.12 (adapted from 
Mills et al., 1978 ) indicate whether the displayed data are: required (1), 
frequently required (2), or merely of additional value (3) at a certain stage 
of the mission. Thus, an entry of "2" or "3" signifies that this particular 
information is less essential than information assigned a weight of "1." 
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IFF/Slf Procedure* 
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6.0 PILOT PERFORMANCE AND 

BIOCYBERNETIC APPLICATIONS 


The preceding sections have provided a framework for discussing pilot 
tasks. As we noted earlier, the assignment and sequencing of tasks are 
dependent upon the aircraft characteristics, the tactical objectives, and the 
information requirements. 

Subsection 6.1 attempts to convey the dynamic, time-varying nature of 
pilot tasks. Subsection 6.2 then describes the biological signals which 
reflect the pilot's status or which may permit a direct coupliny of the pilot 
with aircraft subsystems. Finally, Subsection 6.3 examines the manner in 
which biocybernetic techniques can be expected to improve pilot performance 
and thus enhance weapons system effectiveness. 


6.1 TIME LINE ANALYSES OF PILOT TASKS 


To avoid the redundancy of presenting detailed task listings for each 
mission type, we have generated time lines for those tasks commonly associated 
with segments of a carrier launched escort mission. Figure 6.1 shows that 
most of the mission segments integrate several of the general mission require¬ 
ments illustrated previously in Figure 3.4. Further, we have included both 
air-to-air and air-to-ground scenarios, as evident from the representative 
mission profile depicted in Figure 6.2. 
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FIGURE 6.1 SEGMENTS OF A CARRIER LAUNCHED ESCORT MISSION. (THE 
FIGURE SHOWS THE RELATIONSHIPS BETWEEN SEGMENTS AND 
MISSION REQUIREMENTS PRESENTED PREVIOUSLY IN FIGURE 3.4. 
SOME OF THE SEGMENTS (E.G., MRI) ARE COMPRISED OF 
SEVERAL MISSION REQUIREMENTS.) 
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In the construction of dynamic task flows (Figures 6.6 through 6.17), we 

have incorporated existing documentation on the multimission F/A - 18 air¬ 
craft (Wise and Asiala, 1977). The crew station of this aircraft (see Fiyure 
6.3) has been designed for both air-to-air and air-to-ground inodes, and it 
features many of the avionics advances highlighted in Section 3. 

We stated in the Introduction that we would restrict the application of 
biocybernetic techniques to those pilot tasks which are very difficult, are 
critical to the success of the mission, or occur during periods of heavy 
workload. In order to eliminate less essential tasks from later consideration 
(more inclusive listings of tasks appear in the time line analyses), military 
pilots familiar with the F/A - 18 crew station and with the projected mission 
requirements rated each task on the basis of difficulty and criticality. The 
following factors were taken into account when judging task difficulty: 
o amount of information that must be processed, 
o degree to which the relevant cues are discernible, 
o number of control actions and precision with which they must be 
performed, 

o time available to perform the task (or a cluster of related tasks), 
o dependence upon an integrative process in reaching a decision, 
o other variables (such as stress, fear, or fatigue). 

While the relation of the task to the success of the mission was emphasized 
in estimating criticality, the pilots also indicated whether performance of 
the task affected flight safety. 
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We have defined workload in terms of the number of tasks a pilot must 

perform in an arbitrary period of time. For each mission segment, we counted 
the number of individual tasks, including repetitions of the same task, which 
are presumed to occur in a 5 second interval (see Figure 6.4). Tasks which 
continue in successive intervals were counted for both time periods. Descrip¬ 
tive statistics were derived from these tabulations. Across the entire 
mission, mean "task load" per 5 second interval was equal to 3.93 tasks, with 
a standard deviation of 1.77 tasks. High task load intervals were assumed to 
have task frequencies greater than 7.47 (two standard deviations above the 
mean). The tasks which appear in these intervals and the tasks assigned high 
ratings with regard to difficulty or criticality comprise the row headings of 
the biocybernetic matrices in Subsection 6.3. 

The time lines which follow are meant to be illustrative, since the 
duration of any mission segment will change dramatically as conditions 
change. To demonstrate the process of creating dynamic task flows, we have 
presented complete time lines for launch, surface-to-air missile (SAM) 
avoidance, air combat maneuvering (ACM), and landing. For the remainder of 
the mission segments, time lines are provided for only the high task load 
intervals. In general, the task listings should be read from bottom to top. 
Further, the reader may find it helpful to refer again to the relevant 
mission and information requirements described in Sections 4 and 5, respec¬ 
tively. A brief narrative introduces each mission segment. 
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6.1.1 Launch - Within this 60 second segment, the pilot catapults from 
the carrier, establishes and maintains proper attitude for climb, and retracts 
the landing gear and flaps for normal flight. Throughout the segment, 
critical flight data are processed and attitude adjustments are performed. 
Visual search of surrounding airspace is required to monitor the position of 
the other escort aircraft (assuming a dual launch). 
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6.1.2 Cl imb - The lead pilot joins with his wingnian, and they climb 
to their assigned altitude. Both pilots are in constant communication with 
the air traffic controller and with each other. Climb and level-off checks 
are frequent, as is the monitoring of other flight parameters. Once clear 
of the carrier, the pilots establish proper spacing between their aircraft 
and then engage the Automatic Flight Control System (AFCS). The flight 
monitoring tasks continue throughout the mission segment. Additionally, the 
Identification-Friend or Foe (IFF) system is activated, and preliminary 
subsystems checks are performed. 
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6.1.3 Rendezvous - The escort pilots are principally concerned with 
joining the strike force. Radar parameters are selected (to assist in the 
location process) and then a system check is performed. The pilot also must 
achieve UHF communication with the strike force. Since most of the flying is 
conducted under AFCS, task load is relatively low. The pilot continuously 
monitors displayed flight data and the position of the other escort aircraft. 
Once the strike force is joined, the pilot disengages the AFCS to begin 
formation flying. 
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6.1.4 Ingress - This segment commences as the aircraft cross the 
forward edge of the battle area (FEBA). Counter-threat and armament sub¬ 
systems are set and checked, and the pilot flies a level weave maneuver until 
the strike force reaches the target or until ingress is interrupted. To 
reduce the possibility of detection by enemy ground forces, the radar alti¬ 
meter is deactivated. 
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FIGURE 6.8 DYNAMIC TASK FLOWS FOR INGRESS. 
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6.1.5 Medium Range Intercept (MRI) - Should enemy fighters be encoun¬ 
tered, the escort aircraft must defend the strike force. Therefore, fire 
control functions have the highest priority within this segment. Pilot 
responsibilities include: 

o configuring the aircraft subsystems for the appropriate attack 
mode, 

o selecting azimuth and elevation coordinates for radar antenna, 
o monitoring radar display and IFF evaluator, 
o arming and assessing status of selected missile, 
o achieving target lock-on, 

o maneuvering so that the enemy aircraft is positioned within the 
missile launch envelope, 
o firing the missile, 
o observing flight path of the missile. 

The outcome of the engagement is communicated, the master, arm is set to safe, 
and navigation data are processed. The pilot then will proceed to rejoin the 
strike force. 
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6.1.6 Surface-to-Air-Missi1e (SAM) Avoidance - Should a warning of 
possible SAM launch be displayed to the pilot, he must determine the azimuth 
of the SAM site and inform the other pilots of the direction of the threat. 
If a SAM 1 auncli is confirmed, the pilot must bt^in to search visually for the 
missile. He also will dispense chaff and flares to decoy the missile or will 
initiate jamming to confuse the missile's radar. If the missile cannot be 
detonated or avoided in this manner, the pilot must perforin evasive flight 
maneuvers. He will track the smoke trail of the missile so that he may time 
the necessary abrupt changes in altitude, velocity, and direction. 
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6.1.7 Air Combat Maneuvering (ACM) - When "beyond visual range" threats 
are first encountered, long or medium range missiles (Subsection 6.1.5) are 
deployed. Should these weapons prove ineffective (due to enemy maneuvering 
or an inability to achieve lock-on) or should enemy aircraft successfully 
avoid radar defenses, then close-in combat will result. Consequently, within 
this segment we are concerned with those tasks related to either AIK-9 
(Sidewinder) missile or gun attack. It should be noted that crucial flight 
ana weapons data are displayed on the HUD in order to maximize the time 
available to the pilot for visually tracking the enemy aircraft. A compli¬ 
cating factor is the high g environment in which the tasks must be performed, 
since violent rnanuevering is required to properly align the weapons with the 
target and to position the target within the missile launch or gun envelope. 
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6.1.8 Ai r-to-Ground (A/G) Strike - Escort aircraft may participate in 
attack of ground targets, especially during Air Interdiction. We have 
assumed low altitude penetration and that the location of the targets is 
stored within the TACAN computer prior to the mission. Moreover, we have 
assumed delivery of ballistic weapons and, given consent, that the actual 
time of release is computed automatically. The pilot must select the approp¬ 
riate armament program and determine that he is in the vicinity of the target 
area before he initiates "pop-up." When he reaches target-unmask altitude 
and acquires the target visually, the pilot will maneuver the aircraft until 
the target is observed to be within the HUD field-of-view. He then will 
depress the "pickle" (weapons release) button and continue to track the 
target until the flashing symbology indicates release of the bomb. This cue 
also signals pull-up, and the pilot subsequently will establish heading for 
egress from the target area. 
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FIGURE 6.12 DYNAMIC TASK FLOWS FOR AIR-TO-GROUND STRIKE. 
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6.1.9 Egress - This segment commences as the aircraft leave the target 
area. The pilot frequently processes flight data, adjusts flight controls, 
and monitors surrounding airspace. Further, counter-threat and armament 
subsystems are reset and rechecked. 
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6.1.10 In-F 1 i ght Refuel - While in cruise, the pilot will select 
altitude, heading and attitude coordinates for the Automatic Flight Control 
System (AFCS). He also will designate the approximate location of the 
tanker aircraft and will adjust radar parameters for a more precise deter¬ 
mination of the refueling site. Once lock-on is achieved, the pilot will 
deactivate the AFCS to maintain close formation during approach to the tanker 
fleet. Rendezvous typically will occur at 20,000 ft., at least 50 nm from 
the FEBA. The remainder of the tasks within this segment are associated with 
the actual refueling operation (e.g., extension of the probe, activation of 
the refueling switches, and retraction of the probe). 
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6.1.11 Marshal - Prior to approach for carrier landing, the escort and 
strike aircraft will break formation and will descend to establish a holding 
pattern until clearance is received. While in the pattern, the pilot will 
engage the AFCS in order to perform various housekeeping checks arid to 
configure the subsystems for approach and landing. He also will monitor Ins 
position in the pattern to assure proper in-flight alignment (IFA) during 
approach. In addition, IFF codes are again verified to maximize classifica¬ 
tion of "beyond visual range" threats. Finally, the Instrument Landing 
System (ILS) is set to standby and the proper heading is selected. 
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6.1.12 Prel andi ng - During approach, the pilot's principal objectives 
are to arrive at the outer marker: 
o in the assigned time slot, 

o at the appropriate altitude, attitude, heading and airspeed. 
Therefore, housekeeping functions receive the highest priority within this 
segment. 
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6.1.13 Landing - The tasks in this segment are performed during a fully 
coupled approach. A carrier-based system monitors relevant flight parameters 
(attitude, altitude, heading, glide slope, vertical velocity, and airspeed) 
and, via data link, automatically adjusts the aircraft's flight controls to 
compensate either for deviations from commanded levels or for changes in the 
orientation of the flight deck. Essentially, the pilot must process displayed 
flight data and must remain prepared to assume manual control if a system 
discrepancy is detected. He also must extend the gear, flaps and arresting 
hook. Just before touchdown occurs, the pilot must visually track the glide 
path and observe the altitude indicator (meatball) at the end of the runway. 
At touchdown, the pilot must apply thrust until the arresting hook catches. 
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6.2 REAL-TIME ANALYSIS AND INTERPRETATION OF BIOLOGICAL SIGNALS 


Obviously, the pilot is extensively involved in monitoring displays 
and operating controls (flight controls and various subsystem controls). 
Overall mission success will be compromised when individual objectives 
cannot be achieved because the inherent requirements for processing informa¬ 
tion and initiating control actions exceed the capabilities of the pilot. We 
stated earlier that programmable, electronic displays and multipurpose 
keyboards offer one approach to limiting and sequencing display presentations 
according to the pilot's information needs at a given stage of the mission. 
By restricting presentations to essential flight, subsystem, and target 
parameters, the possibility that extraneous visual events will vie for the 
pilot's attention is minimized. Similarly, by integrating critical subsystem 
(e.g., weapons) controls directly into the stick arid throttle, the speed of 
response is increased and the associated expenditure of physical effort is 
reduced. 

These and other engineering advances are certainly important. However, 
we believe that the pilot's effectiveness could be further enhanced if (a) 
his current status as a processor of information and as a decisiori-maker were 
monitored, and (b) he were coupled more directly with the aircraft subsystems 
from a control standpoint. 

We noted in the Introduction of this report that the program of biocyber¬ 
netics research sponsored by DARPA has attempted to develop a communication 
channel for biological signals elicited during different mental activities. 
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It is assumed that through real-time analysis and interpretation of these 

signals the computer will be able to determine (within certain limits): 

o when visual or auditory information has not been processed, 

o when the pilot is inattentive, 

o when the pilot is task-loaded to the extent that he is unable to 
perform additional duties, 

o when the pilot lacks confidence in a decision he has made. 

Subsection 6.3 outlines the courses of action which may be taken should it be 
necessary to unburden or assist the pilot. They include, among others: 

o redistributing task responsibilities by effecting greater automation 
of certain housekeeping functions, 

o reducing the complexity of or "decl uttering" information displays, 
especially the HUD, 

o cueing the pilot to attend to critical flight, weapons, and target 
data, 

o displaying adaptive decision aids which present weighted recommenda¬ 
tions for mission-related decision strategies, particularly with 
respect to fire control functions, 

o furnishing remedial "checklists," 

o optimizing the physical characteristics (e.g., contrast, focus, etc.) 
of imagery and symbolic presentations. 

We also will discuss "thought" commands and eye position sensing as two means 
of supplementing manually operated or voice actuated control systems. 

In order to justify the recording (noninvasive and unobtrusive) of 
biological data, there are certain a priori conditions which must be satis¬ 
fied. According to Donchin (in press), it first must be shown that clearly 
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delineated and unique patterns of biological activity are, in fact, associated 

with specific mental (cognitive) functions; the signals cannot be ambiyuous. 
Moreover, the signals must be interpretable in real-time as the pilot performs 
his tasks. Progress has been made in defining patterns of biological activity 
that are related to the efficacy of various cognitive functions (cf. Thatcher 
and John, 1977; John, 1977). Further, very significant improvements have 
been reported regarding the procedures used to extract (from noise) and 
classify these “messages" in real-time (John et al., 1978). These advances 
notwithstanding, a great deal more must be accomplished (in computer tech¬ 
nology, software development, and the design of physiological monitoring 
equipment) before it is both feasible and practical to implement biocybernetic 
techniques in dynamic, operational environments. Nonetheless, we assume that 
the necessary breakthroughs will continue to occur. 

Our intent in this subsection is to briefly review the biological 
signals which are most relevant for our purposes. Figure 6.18 distinguishes 
the two categories of signals we have considered, that is, brain electrical 
activity and peripheral activity. Since our principal concern is with 
monitoring brain function, the term "peripheral" denotes biological activity 
in response systems other than the central nervous system. The figure also 
lists two types of signals within each category, and, at a more molecular 
level, presents distinct informational features or components of two of the 
four types. 

Of necessity, we have omitted many important details of the basic 
research findings in electrophysiology and biological signal processing which 
provide a foundation for the applications we have suggested. Therefore, we 
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encourage the reader to consult the Proceedings of the DARPA Conference on 

Biocybernetic Applications for Military Systems (Gomer, in press) and the 
many excellent textbooks and chapters (cf. Chapman, 1973; Desmedt, 1979; 
John and Schwartz, 1978; McCallutn and Knott, 1973, 1976; Otto, 1979; Thompson 
and Patterson, 1974) for more complete descriptions of the progress that has 
been made in these areas. 

6.2.1 Brain Electrical Activity - In order to evaluate brain function 
while a crew member performs a demanding task, we must rely upon electro- 
physiological techniques to observe the underlying interactions within and 
between populations of cortical cells. Donchin (in press), John (1977), and 
Thatcher and John (1977) have suggested that cognitive operations can be 
conceptualized in terms of coherent patterns of activity within distributed 
cell groups. And importantly, orderly neural behavior gives rise to rhythmic 
voltage fluctuations in the two types of scalp recorded electrical activity 
identified in Figure 6.18. 

El ectroencephal ographic (EEG) activity consists of spontaneous or 
on-going voltage fluctuations (see Figure 6.19). Event-related potentials 
(ERPs), on the other hand, are transient voltage fluctuations which are 
associated with a critical inducing event (i.e., a sensory stimulus or a 
cognitive operation) and which are imbedded in the EEG activity. Since the 
EEG is generally more pronounced in amplitude, it usually obscures the 
waveform of the ERP. However, there are several strategies for extracting 
and measuring ERPs (or selected "components") in real-time (John et al., 
1978). 
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FIGURE 6.19 ELECTROENCEPHALOGRAM OF A NORMAL HUMAN ADULT. (ALPHA WAVES 
AT ABOUT 10 PER SECOND PREDOMINATE IN ALL REGIONS BUT ARE 
LARGEST POSTERIORLY. ONLY A FEW SMALLER AND FASTER BETA 
WAVES ARE VISIBLE IN THE ANTERIOR REGIONS. (FROM LINDSLEY, 
1948)) 
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If a discrete visual stimulus is presented to an observer who must 

classify it and then signify the decision he has reached with a behavioral 
response, the resultant ERP is composed of successive positive and negative 
deflections continuing for up to 750 msec post stimulus. Figure 6.20 depicts 
such a waveform in which the major deflections or components have been 
labeled by a character-number designation. The character refers to the 
polarity of the component (P = positive, N = negative), while the number 
indicates the temporal delay or latency between the eliciting event and the 
peak voltage of the component. 

The morphology of the components occuring within 200 msec after stimulus 
onset is influenced markedly by the physical attributes (e.g., wavelength, 
intensity or contrast) of the evoking stimulus (cf. Regan, 1972). Conse¬ 
quently, these so-called early components are referred to as exogenous. If 
the input must be processed and a decision reached, the prominence of late or 
endogenous component activity, particularly P.j 00 , i s affected. The term 
"endogenous" signifies that these components are not affected by the sensory 
qualities of external events. 

The location of recording electrodes must be given careful consideration 
when denoting the amplitude and latency of ERP components. This follows from 
the previously stated position that neural representations of information 
processing and decision-making involve the coordinated behavior of disparate 
cell populations. Thus, the spatiotemporal distribution of late component 
activity, when referenced to the International Electrode Placement System 
(Figure 6.21), is a most important indicator of cognitive function (cf. Adam 
and Collins, 1978; Courchesne, et al., 1975; Goff, et al., 1978; Thatcher, 

1976 ). 
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.20 VERTEX EVENT-RELATED POTENTIAL ELICITED BY A MATCHING 
LETTER PRESENTATION DURING AN ITEM RECOGNITION TASK. 
(FROM GOMER ET AL., 1976) 
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FIGURE 6.21 LATERAL AND SUPERIOR VIEWS OF INTERNATIONAL ELECTRODE 
PLACEMENT SYSTEM. 
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One may question whether it will be possible to evaluate some of the ERP 

components during tactical missions, since discrete visual events are rarely 
presented to the pilot (other than in the form of check list items). Rather, 
alpha numerics, symbolic characters, and sensor imagery are displayed continu ¬ 
ously , and they change in content or value dynamicall,y . Donchin (in press) 
has shown that discrete probe stimuli (in this case auditory) can be intro¬ 
duced artifically into those situations in which dynamic visual events 
predominate. By analyzing "background" responses (principally P^qq ) to 
these probes we can infer how well the operator is performing "foreground" 
tasks. 

"Foreground" activities can be assessed directly however. That is, we 
can evaluate the EEG changes which accompany i nformat ion processing and 
decision-making operations that are integral to the housekeeping and mission- 
related tasks performed by the pilot. The EEG is categorized with respect to 
two basic dimensions, frequency and amplitude. Usual frequency bands are: 

o delta (.5 - 4Hz), 

o theta (5 - 7Hz), 

o alpha (8 - 12Hz), 

o beta (18 - 30Hz). 

Energy distributions can be measured within these and more restricted fre¬ 
quency bands at each recording site. In fact, energy asymmetries in homo¬ 
logous leads (left vs. right hemisphere) may be quite sensitive to subtle 
differences in cognitive function. 
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Figure 6.18 lists other endogenous components, two of which are of 

additional value for monitoring pilot status. The contingent negative 
variation (CNV) is a slow, negative shift in EEG baseline which develops in 
the interval between successive presentations of discrete stimulus events 
(see Figure 6.22). The time course, amplitude, and scalp distribution of 
this waveform provide a general index of attentiveness (Donchin, in press). 
Thus, the probe technique which has been used to elicit P 300 can also be 
used to generate CNV responses. The detection potential (DP), in contrast, 
is a transient change in EEG activity which is associated with the detection 
of dynamic target events (McCallum, in press; Cooper et al., 1977 ). McCall urn 
and his colleagues discovered this event-related slow potential during 
preliminary studies of extended vigilance performance. Operators viewed a 
static landscape which was displayed on a television monitor. At random time 
periods, one of several vehicular targets would appear in the scene and 
traverse the terrain along a prescribed route. These scientists found that a 
well defined, positive-going potential reliably preceded behavioral indica¬ 
tions of target detection (see Figure 6.23). Moreover, control experiments 
have established that this component is not related to the initiation of 
motor responding per se and that it has a predominant centroparietal scalp 
distribution. If the scope of these investigations can be expanded to 
incorporate more demanding target acquisition requirements, then the pilot's 
participation in a very important fire control function can be monitored 
directly. 
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Si S 2 



FIGURE 6.22 TYPICAL CNV WAVEFORM RECORDED FROM VERTEX ELECTRODE PLACEMENT. 

(SI AND S2 DENOTE SUCCESSIVE STIMULUS EVENTS.) 
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FIGURE 6.23 (TOP) THE DISPLAYED SCENE AND (BOTTOM) THE EYE-SCAN PATTERN AND VERTEX EEG 
OF ONE SUBJECT BEFORE AND AFTER DETECTION OF VEHICLE. (THE VEHICLE 
TRAVELED FROM RIGHT TO LEFT ACROSS THE MIDDLE OF THE DISPLAY, AT THE 
START OF THIS SECTION OF THE RECORD THE EYES WERE LOOKING AT THE CENTER OF 
THE DISPLAY. AT A THE EYES MOVED TO THE LEFT SIDE AND SCANNED THERE UNTIL 
B WHEN SACCADES TO THE UPPER CENTER C AND RIGHT DE_ OCCURRED, FOLLOWED BY 
DETAILED MOVEMENTS LEADING TO THE DETECTION POTENTIAL AT F AND TRACKING 
THEREAFTER. ALL SIX VEHICLES ARE SHOWN. (FROM COOPER ET AL., 1977)) 
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We stated earlier that the recording and analysis of brain electrical 

activity also may permit a direct coupling of the pilot with aircraft sub¬ 
systems from a control standpoint. At issue is whether it will be possible 
to interpret bioelectric manifestations of different thoughts as they occur, 
whereby the pilot can "think" to activate switches or guide control actions. 
Pinneo and his colleagues at Stanford Research Institute were funded by DARPA 
to develop this particular communication link (Pinneo et al., 1975 ). Their 
primary objective was to isolate features in the EEG data that are associated 
with specific thoughts. They also attempted to devise computer pattern 
recognition programs that would identify these features on-line. For a small 
vocabulary of individual commands, they concluded that consistent patterns 
are present in that EEG activity which is coincident with the thinking of a 
particular word. Further, these patterns can be recognized and classifed by 
a computer a statistically significant percentage of the time. It must be 
noted, however, that this process is not yet sufficiently reliable to be used 
in a practical system. 

There often is a need to increase the speed with which a control action 
is initiated, such as in weapons release during air-to-air gun attack. 
Researchers have discovered a negative slow potential shift, termed the 
"readiness potential" (RP ) (see Figure 6.24), which precedes the actual 
execution of a voluntary manual response by as much as several hundred 
milliseconds (cf., Donchin, 1979; Gai1 lard, 1978). It is an electrophysio- 
logical indication of the intent to commence responding. This negative wave 
should not be confused with the CNV that was described previously. Whereas 
the RP is movement-related, the CNV is influenced by variables which modulate 
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FIGURE 6.24 EXAMPLES OF VERTEX READINESS POTENTIALS ASSOCIATED WITH 
FINGER PRESSES DURING A REACTION TIME TASK AND DURING 
VOLUNTARY MOVEMENTS. (FROM GAILLARD, 1978) 
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attentiveness to task demands. Moreover, Gaillard (1978 ) notes that the RP 

is distributed more posteriorly than the CNV and that the RP is bilaterally 
asymmetrical while the CNV is bilaterally symmetrical. 

To reiterate, there are certain conditions which must be satisfied 
before el ectrophysiological signals will be valuable in the context of 
military applications. With respect to monitoring pilot status, clearly 
delineated and unambiguous patterns of brain electrical activity must be 
associated with information processing, attentiveness, and decision-making. 
Further, optimal patterns of activity (profiles) must be defined for these 
cognitive functions as a pilot successfully performs housekeeping and 
mission-related tasks. The profiles must be continuously updated and stored 
in computer memory onboard the aircraft. Current el ectrophysiol ogical data 
which are recorded during the various stages of the mission must be evaluated 
in comparison with the profiles for deviations from acceptable levels. In 
the case of control system applications, we again must identify specific 
features of brain electrical activity which, in this instance, correspond 
with distinct thoughts and with the intent to initiate a manual response. 

And as we stated with regard to pilot status, current electrophysiological 
data must be matched, in real-time, with these unique profiles. 

6.2.2 Peripheral Activity - While we have deliberately focused on brain 
electrical activity and cognitive function, we recognize the importance of 
monitoring the pilot's reaction to chronic and acute stress. We are referring 
not only to environmental stressors, such as g forces or hypoxia, but also to 
psychological stressors, such as workload. If considerable bodily resources 

must be mobilized for extended time periods to restore the "status quo," then 
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the pilot's proficiency in performing critical tasks will deteriorate. 

Therefore, we assume that sustained increases in certain types of biological 
activity (or perhaps in the variability of a particular measure) will reflect 
difficulty in coping with stress. We very briefly describe psychophysio- 
logical activity in three response systems that have been studied to assess 
levels of anxiety, tension, or physical effort. 

Within this subsection we also review ocular activity from two perspec¬ 
tives. We begin by examining the dynamics of eye movements (i.e., timing, 
velocity, and pattern) as they relate to information extraction and proces¬ 
sing. Then we discuss the concept of eye control. 

6.2.2.1 Psychophysiological Responses - Surface recordings of electro¬ 
myographic (EMG) activity are widely used to evaluate changes in tension and 
physical effort (cf. Goldstein, 1972; Johnson, in press). Electrodes are 
placed on the skin over various muscle groups, although forehead and neck 
leads are usually included when the effects of psychological stressors are 
examined. The electrical activity generated in the muscles is frequently 
rectified and integrated over an interval of time, the duration of which 
depends upon the purpose for the recording. 


Shifts in cardiovascular activity also occur in response to stress and 
changes in physical effort. The parameters of interest to most investigators 
have been (a) heart rate and rhythm and (b) blood flow and pressure (Gunn et 
a 1 ., 1972 ). Heart rate (HR) has been the preferred datum when evaluating 
anxiety or tension, due largely to practical difficulties in acquiring the 
other data during simulation and operational testing. Direct measurement 
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techniques consist of (a) recording the electrical activity generated by 

contraction and relaxation of cardiac muscle - the electrocardiogram (ECG), 
and (b) detecting the corresponding heart sounds - the phonocardiogram. 
Indirect techniques usually involve some form of sensing the changes in 
peripheral blood flow. There is a question, however, whether fluctuations 
in mean HR or in HR variability provide the most sensitive indication of 
physical status. 

Similarly, both the rate and depth of respiration increase significantly 
when subjects are exposed to periods of stress. The most common methods for 
measuring these parameters incorporate impedance, strain gauge, or thermistor 
techniques. It must be noted that respiratory patterns are disrupted by 
speech, thereby limiting the value of rate and amplitude recordings during 
certain mission segments. 

Our goal, as far as monitoring the pilot is concerned, is to identify 
consistent patterns of activity - not only in individual psychophysiological 
measures but in a group or groups of measures - that are related to distinct 
changes in anxiety, tension, and physical effort. 

6.2.2.2 Ocular Activity - It is generally accepted that eye movements 
reflect the observer's distribution of attention within visual space (cf. 
Krebs et al., 1977). However, the timing and velocity of these movements may 
also reveal the effectiveness with which a pilot processes information. We 
suggest that ocular measures may supplement electrophysiological measures of 
cognitive function during display monitoring tasks. A more detailed discus¬ 
sion of the types of eye movements and their relation to perception and 
cognition is presented by Cumining (1978). 
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Large movements orient the eye so that the high resolution area of the 

retina (the fovea) is directed toward the point of interest within the visual 

scene. We can define three classes of large eye movements. Saccades are 

voluntary, abrupt changes in fixation between points located at the same 

viewing distance. They are characterized by accelerations and decelerations 

2 

of up to 40,000 deg/sec and by peak velocities of 480 to 6GU deg/sec. 
Saccadic eye movements during visual search typically subtend 1 to 40 deg. 
Smooth movements, on the other hand, occur when the eyes track an object 
which moves vertically, obliquely, or laterally in the range of 1 to 30 
deg/sec. These movements are also produced to compensate for head or body 
motion as the observer fixates on a stationary object. Finally, vergence 
movements allow the eyes to adjust to changes in viewing distance or depth. 


Even when an observer carefully attempts to maintain precise fixation, 
small movements inevitably persist. These movements are classified as 
tremor , microsaccades , and drifts . According to Cumming (1978): 


"Tremor is a small, irregular lateral oscillation with frequency compo¬ 
nents up to 100 Hz and an amplitude equivalent to a few foveal cone 
diameters. Microsaccades are small, fast, conjugate flicks, taking some 
20 msec and moving the eyes a few minutes of arc. Between microsaccades 
the eyes drift haphazardly at about 5 min of arc/sec, with tremor 
superimposed on the drifting motion. The two eyes drift independently 
and probably also undergo tremor independently, and so these movanents 
have usually been attributed to unavoidable residual instability in the 
oculomotor system." (p. 224) 


We are most concerned with the dynamics of large eye movements that 
occur as the pilot scans displays and the visual scene outside the crew 
station. Two-stage models of visual perception hold that events of interest 
are located initially via peripheral vision; this leads to fixation and, 
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therefore, more detailed analysis. Many Investigators believe that fixation 

implies attention. However, the relationships between the velocity and the 
amplitude (angular distance) of saccadic eye movements may provide additional 
insights concerning fluctuations in attentiveness or in decision strategy 
(Stern, 1978). Equally as important in this regard are temporal parameters, 
such as fixation duration (dwell time), since unusually long or short fix¬ 
ation pauses may reflect periods in which visual information is not beir^ 
processed. 

Young and Sheena ( 1975 ) have surveyed most of the procedures for meas¬ 
uring eye movements and eye position within the laboratory. Unfortunately, a 
major shortcoming of many measurement techniques is that they require varying 
degrees of head stabilization to achieve accurate determinations of eye 
position. This obviously limits their usefulness in operational crew sta¬ 
tions. Thus, it is noteworthy that the military has developed procedures for 
transmitting head position (and, in an indirect manner, 1ine-of-sight) 
coordinates to create a close coupling of the pilot with aircraft subsystems 
from a control standpoint. 

Furness (in press) has reviewed several methods for deriving line-of- 
sight data in the cockpit to facilitate the aiming of weapons, the designa¬ 
tion of ground targets, or the activation of control surfaces. One system 
which has been developed incorporates a tightly fitted helmet and a parabolic 
visor. A gunsight reticle is projected via an optical assembly onto the 
center of the visor. The reticle appears as a 10 mil ring within a 50 mil 
ring and is collimated. Two lead sulfide photodiodes are located on each 
side of the helmet, and, of course, their positions are constant with respect 


124 

mcoowwcll oouaLMm 4«rirow4urics coMPAivy-ar. louw divimom 










BIOCYBERNETICS AND PILOT PERFORMANCE 

1 OCTOBER 1979 MDC E2046 

to the position of the reticle. In principle, as the crew member moves his 

head and superimposes the reticle over a target of interest, the relative 
positions of these two photodiodes are measured and translated into line-of- 
s i y hi t information. To accomplish this, an infrared scanning device is 
located behind the crew member on the canopy rail. It generates two parallel 
planes of infrared light that rotate throughout tlie cockpit and illuminate 
the two photodiodes. The signals from the photodiodes and the timing signals 
from the scanner are transmitted to a special-purpose digital computer. The 
computer determines the positions of the photodiodes in three-dimensional 
space and resolves the resultant vector into azimuth and elevation angles. 
Once relative azimuth and elevation coordinates are knov/n, they are combined 
with information about aircraft boresight to specify, in an absolute sense, 
precisely where the crew member is aiming his head (and thus directing his 
gaze). 


El ectro-ocul ographic (EOG) and, to a lesser extent, oculometer tech¬ 
niques permit the recording of eye movements without placing restraints on 
allowable head movements. Merchant (in press) has recently described the 
development of a helmet-mounted ocul ometer, the design of which is based on 
the visor-projected reticle system used to infer 1 ine-of-sight in the cock¬ 
pit. In this adaptation, the reticle generator on the side of the helmet is 
replaced with miniaturized versions of the oculometer sensor and the infrared 
illumination source. The latter projects light rays off the parabolic visor, 
while the former views a reflected image of the eye. Not only can the dynam¬ 
ics of 1 arge eye movements be studied in this manner, but eye position can be 
determined directly by measurement of the distance between the corneal reflec¬ 
tion (of the light rays from the illumination source) and the pupil center. 
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6.3 BIOCYBERNETIC APPLICATIONS 


Our premise has been that system effectiveness can be improved drama¬ 
tically if the central computer is made aware of momentary shifts in operator 
status. In addition to monitoring transient aspects of cognitive function, 
we also believe it worthwhile to assess more long term or general status, as 
influenced by such factors as fatigue, anxiety, and physical well-being. 

The previous subsection (6.2) documented that mental activities are 
indeed manifest in a variety of biological signals. Subsequent to computer 
analysis of the informational content (both phasic and tonic) of these 
signals, we suggested that it would be possible to unburden or assist the 
pilot through: 

o redistribution of task responsibilities by effecting greater automa¬ 
tion of certain housekeeping functions, 

o reduction in the complexity of information displays, especially the 
HUD, 

o cues for the pilot to attend to critical flight, weapons, and target 
data, 

o presentation of adaptive decision aids which recommend mission-related 
strategies for fire control functions, 

o recall of checklist items, 

o more optimal adjustments of the physical characteristics (e.g., 
contrast, focus, etc.) of imagery and symbolic displays. 
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Moreover, we noted that (a) pattern analysis of brain electrical activity 

associateu with either distinct "thought" commands or the intent to initiate 
movement and (b) eye position sensing, provided separate means of augmenting 
(especially in terms of speed) manually operated and voice actuated controls. 

Figure 6.25 presents the biological signals listed earlier in Figure 
6.18, but now links them to specific applications. With respect to electro- 
encephal ographic activity, we presume that distinctive features are sensitive 
to continual as well as sudden cognitive demands. Remember that "features" 
refer to energy distributions within restricted frequency bands and to 
possible asymmetries in these distributions across standard recording sites. 
Other features of EEG activity may emerge as trained pilots "think" particular 
commands, thereby creating the necessary inputs to initiate and guide control 
actions. As evident from the figure and the text of Subsection 6.2, exogenous 
and endogenous components of event-related potentials are also valuable 
sources of pilot information. For example, by referencing the time course, 
amplitude, and locus of maximal response for exogenous components of visual 
ERPs (since each of these attributes change as image quality and contrast are 
manipulated (cf. Gomer and Bish, 1978)), display settings can be adjusted 
automatically to achieve criterion levels of display performance. Regan (in 
press) recently has proposed such a "feedback loop" for a form of exoge¬ 
nous activity labelled steady-state. 

Returning to Figure 6.25, the suggested applications for endogenous 
components of ERPs require no further explanation. However, we should review 
the information-bearing properties of the different types of peripheral 
activity, as well as some of the headings we have employed to depict their 
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usage. Previously, we described psychophysiological activity in three 

response systems that have been monitored extensively to assess tension and 
physical effort, particularly following the onset of stress. Therefore, we 
have grouped these response systems together and assumed that the principal 
virtue of recording from them will be to denote changes in "physical status." 
Again, sustained increases in the behavior of these response systems, if 
caused by prolonged exposure to stress, should forewarn an imminent deter¬ 
ioration in pilot proficiency. Finally, the dynamics of eye movements 
(i.e., timing, velocity, and pattern) should serve as an additional indica¬ 
tion of the effectiveness with which a pilot extracts and processes displayed 
information. 

In taking the process to its logical conclusion, Figures 6.26 through 
6.38 present biocybernetic applications as a function of individual pilot 
tasks. These are tasks which occur within the various segments of the escort 
mission we described before in Subsection 6.1. For each of the tasks which 
must be performed, we have indicated whether we are seeking status inform¬ 
ation of some sort, or whether we intend to supplement conventional methods 
of control system activation. 

We recommended earlier that biocybernetic applications be restricted to 
those pilot tasks which are very difficult, are critical to the success of 
the mission, or occur during periods of heavy workload. Whereas the original 
task listings in Figures 6.6 through 6.17 are quite complete, we now have 
eliminated less essential tasks (with respect to difficulty, criticality, or 
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workload considerations) in constructing the biocybernetic matrices which 

follow. Moreover, to avoid unnecessary redundancy in the format of succes¬ 
sive figures, we show just those tasks which have not appeared in any of the 
preceding matrices (starting with Figure 6.26). For example, although the 
pilot must determine altitude during launch as well as climb, this task is 
entered as a row heading only in the matrix devoted to launch. 
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FIGURE 6.26 BIOCYBERNETIC APPLICATIONS AS A FUNCTION OF PILOT TASKS 
DURING LAUNCH. 
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7.0 CONCLUSIONS AND RECOMMENDATIONS 


In proposing to add a communication channel from the pilot to the 
central computer, we have shown that electrophysiological measures are 
relatable to pilot status and, ultimately, to performance. Further, we have 
made the distinction between the long term changes in cognitive function that 
occur across the mission, and the more transient aspects of information 
processing and decision-making which are associated with specific pilot 
tasks. As McCallum (in press) notes, however, it has not been determined 
whether a single physiological measure can serve as a reliable index of 
operator status, or, rather, if several response systems must be monitored 
to reveal operator states which may threaten performance. This issue of 
single vs. multiple inputs also must be resolved in deciding upon the most 
effective means of augmenting conventional methods of control activation. 

We did not rank the various mission segments when suggesting biocyber- 
netic applications in the last subsection. A ranking could have been made 
dependent upon the relative importance of each mission segment, either with 
respect to the overall mission objectives or with regard to survivability. 
Clearly, if we were forced to be selective (perhaps due to cost/benefit 
considerations) in applying biocybernetic techniques, we would choose those 
mission segments or requirements for which the pilot is especially vulnerable 
and both the accuracy and speed of performance are critical. In reviewing 
the in-flight mission requirements presented in Section 4, we find that the 
following, which occur during air-to-air or air-to-ground engagements, place 
the greatest demands on the pilot: 
o penetration 
o threat warning 
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o detection 

o location 
o identification 
o decision 
o execution 
o assessment 

The principal tasks which must be accomplished within these mission require¬ 
ments may collectively be termed fire control functions. That is, we are 
concerned with the pilot's ability to establish correct range, azimuth, 
elevation, and/or FOV coordinates for the sensors used during the target 
acquisition process. Moreover, we are concerned with his ability to interpret 
multisensor imagery and to select laser/EO designators and, if necessary, 
countermeasures. Then, if we assume that appropriate range and/or velocity 
considerations have been taken into account in choosing the weapon, that 
arming has been accomplished prior to the engagement, and that the actual 
time of release is computed automatically, we are concerned with the pilot's 
ability to maneuver the aircraft so that the target is positioned within the 
missile launch or gun envelope. Superimposed upon these responsibilities is 
a general accountability for flight control, navigation, communications, 
subsystems monitoring, and, especially, threat detection/evasion. 

As the pilot participates in fire control functions not managed directly 
by the computer, our principal information needs are related to momentary 
fluctuations in the pilot's capacity to process information and reach deci¬ 
sions. If real-time measures of pilot status are available, computer graphic 
techniques can be called upon to create pictorial and symbolic displays with 
sufficient detail to lead the pilot through changing tactical situations and 

145 

*•COOMVCLL DOUOLAa 4(rm)W4VriC« COMP4NV-<r. LCHJia OIVIMOM 


■V 


~rr 















BIOCYBERNETICS AND PILOT PERFORMANCE 

1 OCTOBER 1979 MDC E2046 

weapons procedures. These decision aids will enable the pilot to adopt 

strategies for action which are in accordance with the current posture of the 
mission. 

Most of the el ectrophysiological studies we cited earlier took place in 
university 1aboratories, and the task demands imposed upon the subjects were 
somewhat constrained from an operational point of view. It is apparent that 
the progression of a program which considers electrophysiological signals as 
input to adaptive military systems will require that investigations be 
extended to appropriate part-task and full-mission simulations. Thus, we 
presently are conducting part-task flight simulations in which we have 
challenged the pilot's ability to make multiple decisions within short 
periods of time. Our intent in these investigations is to further define 
the features of brain electrical activity and eye behavior which, when 
analyzed on-line during the simulation, may forewarm imminent deteriorations 
in pilot performance. 

Finally, we should note that biocybernetic applications are, in fact, 

being addressed by the military laboratories (cf. O'Donnell and Hartman, in 

press). Reising (in press), of the Air Force Flight Dynamics Laboratory, 

has predicted that techniques which yield pilot status information will be 

an essential component of adaptive crew stations in the future. Moreover, 

pattern analysis of "thought"-related EEG activity for control purposes has 

been discussed recently by scientists from the Air Force Aerospace Medical 

Research Laboratory (Aviation Week and Space Technology, Vol. 110, Number 5, 

1979, pp. 239-243 ), It would seem that the high-risk program sponsored by 

DARPA over the past several years may significantl; influence R&D activities 

within the military and aerospace industries. 
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